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where functions / and g arc nonlinear and bounded, random variables & are independent 
and h > is a nonrandom parameter. 

We establish results on asymptotic stability and instability of the trivial solution 
x n = 0. We also show, that for some natural choices of the nonlinearities / and g, the 
rate of decay of x n is approximately polynomial: we find a > such that x n decays 
faster than n~ a+e but slower than n~ a ~ e for any e > 0. 

It also turns out that if g(x) decays faster than f(x) as x — > 0, the polynomial rate 
of decay can be established exactly, x n n a — ► const. On the other hand, if the coefficient 
by the noise does not decay fast enough, the approximate decay rate is the best possible 
result. 



In this paper we address the questions of stability and the rate of decay of solutions of 
the difference equation 



where C, n +i are independent random variables. The functions / and g are nonlinear and 
are assumed to be bounded. The small parameter h > usually arises as the step size in 
numerical schemes. Equation (1) may be viewed as stochastically perturbed version of a 
deterministic autonomous difference equation, where the random perturbation is state- 
dependent. In general, it does not have linear leading order spatial dependence close 
to the equilibrium. As a consequence of the non-hyperbolicity of the equilibrium, the 
convergence of solutions of (1) to its equilibrium zero cannot be expected to take place 
at an exponentially fast rate. 

Similarly to deterministic difference equations, analyzing asymptotic behavior of sto- 
chastic difference equations is often harder (see [1, 2, 5, 12, 13, 16, 17, 18]) than analyzing 
their differential counterparts. Nonetheless, we feel it is very important to develop tech- 
niques and better understanding of the similarities and the differences between the two 
types of equations. In this, we are motivated by two principal reasons. Firstly, in many 
applied contexts the studied phenomena are intrinsically discrete (see, for example, [7]). 
Using continuous approximation can sometimes mask significant phenomena. Going in 
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Abstract. We consider stochastic difference equation 




1. Introduction 





the other direction, numerical simulation of stochastic differential equations involves solv- 
ing an associated difference equation. It is important to know whether the discretization 
can produce spurious behaviors and how can this be avoided. For example, one needs to 
study if the asymptotic behavior of the discretized equation is a faithful reproduction of 
the asymptotic behavior of the original equation. The corresponding property is called 
"A-stability" and it has been addressed in the stochastic context in [8], [11], [19]. 

In this paper we analyze sufficient and necessary conditions for solutions x n to converge 
to zero as n — > oo ("stability") and the rate at which such convergence happens for 
different types of the nonlinearities / and g. Our results should be compared to an 
earlier work [4] (see also [3]) in which similar differential equations had been analyzed. 

One of the technical difficulties arising in the study of stability of stochastic difference 
equations is dealing with unbounded noise. So far, many results have been only available 
for the case of bounded noises (e.g. [5]). Yet, one of the most applicable scenarios, 
discretization of the white noise, involves normally distributed (and thus unbounded) 
random variables. In this paper we develop a tool which is designed to overcome this 
difficulty. In particular, it is instrumental in proving the instability result (Theorem 8 in 
Section 4) in this paper and can also be used to prove instability in several related models 
(e.g. in [9, 10]). Section 3 is devoted to setting up this tool, which can be thought of as a 
discrete variant of the ltd formula, and proving the corresponding theorem (Theorem 5). 

Armed with Theorem 5 we formulate and prove criteria for almost sure asymptotic 
stability and instability of solutions to equation (1). In Section 5 we concentrate on the 
decay rate of the solutions (assuming they converge to 0). The principal result here is 
the comparison theorem which provides implicit information on asymptotic behavior of 
solution x n via the limit 



lim 



where S(x) stands for either g 2 (x) or In the special (but typical) cases of polyno- 

mially decaying / and g, we extract explicit information (see Corollary 18) on the decay 
rate of x n in the form of the limit 

lim^ = -A<0. 



n— >oo 



Inn 



The above limit allows one to conclude that the decay rate of x n is of polynomial type. 
More precisely, for any e > 0, the following bound is valid eventually as n — > oo, 

(2) n' x ~ e < \x n \ < n~ x+e . 

At this point a natural question arises: under what circumstances bound (2) can be 
strengthened to the exact power-law decay x n n x — > const? This question is answered 
in Section 6. Heuristically, the answer can be described as follows. The convergence to 
zero can be caused either by the deterministic term f(x) or by the noise term g(x)£, 
depending on the comparative speed of decay of f(x) and g(x) as x tends to 0. When 
f(x) is dominant, the convergence of x n happens at an exact power-law rate. On the 
other hand, if the noise term is significant, we show that an exact rate result is impossible, 
namely 

lim sup |x n |n A = oo, and liminf |x n |n A = 0, 

for some A. 



2. Auxiliary Definitions and Facts 

In this section we give a number of necessary definitions and a lemmas we use to prove 
our results. A detailed exposition of the definitions and facts of the theory of random 
processes can be found in, for example, [20]. 

Let (Q, J 7 , {J r n}nmy P) be a complete filtered probability space. Let {£ n } ne N be a 
sequence of independent random variables with E£ n = 0. We assume that the filtration 
{J r n}nm is naturally generated: T n +\ = cr{£j+i : i — 0, 1, ...,n}. 

Among all the sequences {X n } n( z^ of the random variables we distinguish those for 
which X n are jF n -measurable Vn G N. 

A stochastic sequence {X n } ne ^ is said to be an T n -martingale, if E|X n | < oo and 
E[X n |.F n _i] = X n _i for all n G N a.s. 

A stochastic sequence {£, n }neN is said to be an Tn-martingale- difference, if E|£„| < oo 
and E(^ n |jF n _i) =0 a.s. for all n G N. 

We use the standard abbreviation "a.s." for the wordings "almost sure" or "almost 
surely" throughout the text. 

If {A" n } neN is a martingale, in the form X n = Y^i=\Pi-> then the quadratic variation of 
X is the process (X) defined by 

n 

(x n ) = j2np*\^-i]- 

i=l 

Three lemmas below are variants of martingale convergence theorems (see e.g. [20]). 
Lemma 1. If {X n } ne ?i is a martingale, X n = Y17=iPi' then 



oo 

uj : ^E^l^] < oo j C {X n ->}. 
Here {X n ^} denotes the set of all uj G Vt for which lim X n exists and is finite. 

n— >oo 

Lemma 2. If {X n } ne ^ is a martingale, X n = Y17=iPi> an d 

oo 

X^E^il^i-i] = oo, a.s. 



i=i 

Then, a.s., 



Xn 

0, n — > oo. 



Er=iE[pfi^-i] 

Lemma 3. If X n is a non-negative martingale, then ]im n ^. 00 X n exists with probability 1. 

The following lemma is proved in [2]. 

Lemma 4. Let {Z n } n m be a non-negative T n -measurable process, E\Z n \ < oo Vn G N, 
and 

Z n +i < Z n + u n -v n + v n+ i, n = 0, 1, 2, . . . , 

where {^„}„ g N is an T n -marting ale- difference, {u n } neN , {v n } n <=N are nonnegative Tn- 
measurable processes and E|w n |, E|t> n | < oo Vn G N. 



Then 

: ^ n n < oo > C <uj : u„ < oo > ->}. 



oo 

n=l ) ^ n=l 
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3. DlSCRETIZED ITO FORMULA 

Below we will make use of the notation O(-): 

a(r) 



(3(r) 



< oo. 



(3) a(r) — 0((3(r)) as r — > r ^ limsup 

Here r can be a real number or ±00 and the argument r can be both continuous and 
discrete. We will also use o(-): 

cur) 

a(r) = o{(3{r)) as r — > r lim = 0. 

7--»r p(r) 

Assumption 1. PFe iciZZ ma£;e the following assumptions about the noise £ n : 

(i) £ n are independent random variables satisfying 

E£„ = 0, E£ 2 = 1, E|£„| 3 are uniformly bounded, 

(ii) the probability density functions p n (0 exzst and satisfy 

x 3 p n (x) ^ as I x I — > 00 uniformly in n. 
The following theorem can be thought of as a discretized relative of the Ito formula. 

Theorem 5. Consider ip : R 1 — > R 1 snc/i taat taere exists 0" > and : R 1 — > R 1 

satisfying 

(i) ^= </? on C/5 = [1 - 5, 1 + 5], 

(ii) £ G C^R 1 ) and < M /or some M and all x E R 1 , 



( m ) /ri k - <p\dx < 



00. 



Let / and g be J 7 -measurable bounded random variables; £ be an J 7 -independent random 
variable satisfying Assumption 1. Then 

(4) E[<p(l + fh + gVhi) J r] = <p(l) + <p'(l)fh + ^p-g 2 h + hfo{\) + hg 2 o(l), 

where the error terms o(l) satisfy 

(i) if l/l, |a| < X iaen o(l) ^ as /i — > 0, uniformly in f and g, 

(ii) if h < H then o(l) ^ as / — > and a — > uniformly in h. 

Proof. For brevity we will assume that / and a are constants and correspondingly use the 
non-conditional expectation, the proof of the general case being completely analogous. 

The proof consists of two main parts. In the first part we derive formula (4) for E [0p\ . 
In the second part we prove that, for our purposes, <p is a good approximation for ip. 
More precisely, we prove the following estimate for the error term, 

E[<p-<p\ =hg 2 o(l). 

Part A. By Taylor expansion, 

£(1 + x) = £(1) + ?{l)x + ^x 2 + ?^x\ 

with 9 lying between and x. We substitute x = fh + g^/h^ and take expectation. Using 
properties of £, 

Ex = //i, Ex 2 = f 2 h 2 + g 2 h, 

and therefore 

Eip{x) = ip(l) + $11) fh + ^g 2 h + $'{l)f 2 h 2 /2 + E[$"(9)x 3 ]/6. 



Because <p"'(9) is uniformly bounded, we can estimate, by expanding x 3 , 

\E[ft"(9)x 3 ]/6\ < ME|x 3 |/6 < fh 2 0{fh}' 2 ) + g 2 hO{gh}' 2 ) + g 2 hO(fh). 

This proves formula (4) for tp (l + /ft + gVht^j ■ 

Part B. We introduce the shorthand C\ — 1 + ft/ and c 2 = Vhg and seek an estimate 
for the error term 

A = E [<p (ci + caO - £ (ci + caO] • 

We have 

A = / (^(ci + caO -<?(ci + c 2 0)p(0^ 

= / )n = (<P(r)-(p(r))p[ )t—t, 

Jr 1 \ c 2 J \c 2 \ Jri\U s \ c 2 J \c 2 \ 

where we introduced a new variable of integration, r = c\ + c 2 £, and excluded Us from 
the integration range because ip(r) — <p(r) = on f/^. 
Now we can estimate 

|A| < sup \p ( J 1 — rl / \(p(r) — (p(r)\ dr 

r?U s I \ C 2 J \C 2 \ J J R i 

< \c 2 \ C sup < p [ 1 — - > = hg z C sup ' 



where 



r m { \ c 2 J |c 2 | 3 J r m I ( r - 1 - ^/) f 

r-l-hf 

y = 



Vhg 

If either ft is bounded and /, g — > or |/| and |g| are bounded and ft, — > 0, it is easy to 
see that y — > 00 uniformly on r G IR 1 \ Since under the same conditions (r — 1 — ft/) 3 
is bounded away from zero, the assumption p(y)y 3 — > implies 

sup <^ t 777^ \ = o(l), 

rm { [r - 1 - ft/) 3 J 

and, therefore, |A| < hg 2 o{\). □ 

4. Stability and instability 

We consider equation 

(5) x n+ i = x n (l + hf(x n ) + Vhg(x n )^ n+1 > j , n = 0, 1, . . . , 

with nonrandom initial value io 6 I 1 , and independent random variables £ n satisfying 
E£ n = 0, = 1 for all n G N. The functions g, f : 1R 1 — > R 1 are nonrandom, continuous 
and bounded: 

(6) |<7(«)|,|/(«)|<l Vnel 1 . 

Theorem 6. Let functions f and g be bounded and £„ satisfy Assumption 1. Let also 

(7) sup \m\ =f)<1 . 

//ft small enough then lim^oo x n (uj) = a.s. where x n is a solution to equation (5). 

Remark 7. If g{u) = for some u 7^ 0, we consider (7) fulfilled iff f(u) < 0. Thus we 
impose no restrictions on g{u) when f{u) < for all nonzero u. 
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Proof. We raise equation (5) to a power a > 0, which will be determined later, 



| #71+1 | 



1 + hf(x n ) + Vhg(x n )£ 



71+1 



\ We define (f> a (y) 



\y\ 



denote 



= E 



Q (l + hf(x n ) + ^(l^n+l) 



1, 



2 n 



; (1 + hf(x n ) + Vhg(x n )Cn+i) ~ ®n - l) 



and denote z„ 
(8) 

(9) Pn+l 

and rewrite 

(10) Z n+ i = Z n + ^n$rt + Prt+1- 

Here p n+ \ is an jF n+1 -martingale-difference. Applying Theorem 5 to $ n we have: a (l) = 
1, 0^(1) = a, 0"(1) = a(o; — 1) and, therefore, 

(11) $ 
(12) 



afc/(x B ) (1 + o(l)) + a(a l) hg 2 {x n ) (1 + o(l)) 



1 



< ^ahg\x n ) ((3 + a - 1 + o(l)) , 

where we used condition (7) to obtain the estimate on the second line. Since f3 < 1, 
we can choose a and h sufficiently small, so that $„ < for all x n . Now we can apply 
Lemma 4 with «„ = and v n = —z n § n and conclude that z n converges to some (possibly 
random) value Zqo. 

To prove that is a.s. we assume the contrary: there exists y ^ such that, for 
any 5 > 0, the probability that the limit of z n lies in the interval (y — 5, y + 5) is nonzero. 

At the point y we either have g(y) ^ and then <£>„ < by (12) or g(y) = but then 
f{y)<0 and again $„ < (now using (11)). By continuity, $ n remains bounded away 
from zero in a 5-neighborhood of y. Therefore Y^=i z n&n is divergent which contradicts 
Lemma 4. □ 

It turns out that condition (7) is close to being necessary for stability. For the same 
equation we now ask the opposite question: under what conditions on / and g solutions 
of (5) do not tend to zero. 

Theorem 8. Let f and g be bounded and £ n satisfy Assumption 1. Let also 

f{u) > and g{u) ^ when m ^ 

and 

2|/(«)| 



(13) 



lim inf 

71^0 



g 2 {u) 



> 1. 



If x n be a solution to equation (5) with an initial value x Q G M 1 and h is small enough 
then Pllim^oo x n {uj) = 0} = 0. 



Proof. Consider 
(14) 



$7 = E 



1 + hf(xi) + Vhg(xi)£ i+1 



—a 









with a < 1 and with JF being the trivial a-algebra. Since <p(x) = \x\~ a is integrable 
around x = and has bounded third derivative outside a neighborhood of 0, we can 
apply Theorem 5 to obtain 

= 1 - ahf(x n ) (1 + o(l)) + a{a + l) hg\x n ) (1 + o(l)) . 



In particular, $j are finite. Therefore, we can form 

|l - hf{xi) + Vhg(xi)Z i+1 

M n =n i - — 



i=o * 



Since E|M n | = EM„ = 1 < oo, M n is a positive martingale, convergent by Lemma 3. 
We now have the following representation for the solution x n 



n—1 n—1 



(15) \x n \ a = \x \ a H 1 - hf(xi) + Vhg( Xi )Z i+1 = Ixo^M' 1 J] 0>r\ 



i=0 i=0 



Suppose now that the theorem is untrue, i.e. that P(Jli) > 0, where fli = {uo : 
X\mx n {u)) = 0}. Using condition (13), for each uj G Oi we can find 5 G (0,1) and 
N(u, 5) such that g 2 {x n ) < 2f(x n )(l - 5) for all n > N(u, 5). 

Thus, for n > N(u, 5), 

< 1 + ahf(x n ) ( - 1 + o(l) + (a + 1)(1 - 5) (l + o(l))) < 1, 

when h and a are small enough. 

Applying this inequality to representation (15) we obtain 

\x n \ a > \x \ a M^ 11 <t>-\ 
i=0 

The only n-dependent factor on the right-hand side is M~ x which tends to a nonzero 
limit by Lemma 3. All other factors being nonzero as well, we conclude that x" remains 
bounded away from 0, which contradicts our definition of Q±. □ 

Remark 9. A more refined analysis of the factors in representation (15) allows to strengthen 
the conclusion of Theorem 8 to F {liminf^oo x n {uj) =0} = 0. The proof of this state- 
ment, however, is unpleasantly technical and we leave it out. 

5. Decay Rate 

In this section we establish results on the a.s. decay rate of solutions x n of (5). 

The first subsection contains some variations of the classical Toeplitz lemma from 
analysis. In the second subsection we present a result about asymptotic behavior of In x\ 
in two cases: when lim„^ = L and when lim u ^ = — oo. These conditions 
include, but are weaker than, the sufficient conditions given by Theorem 6 for the stability 
of x n . For this reason we explicitly assume that x n — > when we discuss the rate of decay. 

5.1. Variations on Toeplitz Lemma. In this section we state Toeplitz Lemma and 
prove one of its corollaries. The version of Toeplitz Lemma we need is taken from ([20], 
p. 390). 

Lemma 10 (Toeplitz Lemma). Let {a„}ri e N be a sequence of nonnegative real numbers 
such that X^i a i diverges. If then 

En 

11111 v-^n — K oo- 

We will use the following 2 corollaries of Toeplitz Lemma. 
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Lemma 11. Let {a„}„ e N be a sequence of nonnegative real numbers with YH=i a i ~^ 00 
when n — > 00. T/ien 



Also, 



lim — = c =>- hm ' — = c. 
hmsup =^ = 00 =>- hmsup — = 00. 

n^oo Z_/i=l ^» n^oo On 



Proof. The statement follows from the representation 

lim suj; = lim ^ 

and Toeplitz Lemma. □ 

The following lemma is useful for extracting information about a sequence {y n }nen if 
what is known is given in an implicit form such as f(y n )(y n+ i — y n ) — > c for some 
function /. 

Lemma 12. Let c > 0, let f : M 1 + — > IR^ fre monotonous continuous function. Let 
{2/n}neN a positive increasing sequence such that lim^oo = 1 lim n ->oo Ay n = 

0, w/iere Ay n = y n+l - y n . 

(i) // lim n ^ oc f(y n )Ay n = c, then lim^^ J J^ n /(u)tZu = a 

(ii) // f(y k )Ay k < c, k < n, then \ f£ f(u)du < c. 

(iii) If f(yk)Ay k >c, k<n, then \ ^ f{u)du > c. 

Proof. Since in case (i) we also have lim^^ f(y n+1 )Ay n = c, by Toeplitz Lemma we 
therefore conclude that 

j n— 1 j n 

(16) - Y]/(yj)Ayj -> c, - f(y i+1 )Ayi -> c as n -> 00. 

i=0 «=o 
If / is decreasing, then by geometrical consideration it is clear that 

n-l „ yn n 

(17) ^/( yi )Ay,> / /H^>^/(y m )Ay,, 

i=o Jy° 1=1 

and the result follows from (16). If / is an increasing function, then we reverse inequalities 
in (17). 

To prove (ii) in case of decreasing / we note that 

/ f{u)du < ^2 f(yi) A Vi < cn - 
Jyo j =0 

Case of increasing / and (iii) are analogous. □ 

Corollary 13. Let c, 7 > be non-random numbers. Let {y n } ne n be a positive increasing 
sequence and let 

(18) lim Ay n = 0, lim y^Ay n = c. 

n^oo n^oo 

Then 

-^-( C (l + 7 ))ik. 



Proof. We put f(u) = u 1 for u > 0, and note that y n — > oo by (18). Therefore 

hm = lim ^ ^ X A 



f(y n _ 1 ) rc-oc \y n _i 

Then by Lemma 12 

c= lim — / f{u)du = lim " +1 ^- — = lim 



n^oonj yo n^oo n(j + 1) «^oo n(7 + 1) ' 

and result follows. □ 
5.2. A comparison theorem. 

Theorem 14. Suppose that f and g are bounded with /(0) = <?(0) = and the random 
variables £ n satisfy Assumption 1. Assume, further, that x n — > a.s., where 
solution of (5). 

a) // 

(19) lim4H = L > LeR 1 , 



u^o g 2 (u) 



then 



(20) lim J? 1 *; 1 =hL- h/2. 
b) If f{u) < in a neighborhood of u = and 

(21) lim = oo, 

n^O ^(w) 2 

then 

Ei=i 1/(^)1 

Remark 15. If the initial value a;o is non-zero and the distributions of £ n are non-atomic, 
the solution x n is a.s. non-zero for any n. 

Remark 16. Theorem 8 imposes restrictions on possible values of L. To have convergent 
x n we must have L < 1/2. Then, in equation (20), —h + 2Lh is non-positive which one 
would expect with x n — > 0. 

Proof. We apply logarithm to both parts of equation (5) to obtain the following repre- 
sentation of the solution of the recursion 

fc-i 

(22) In |x fc j = ln|x | +^ln 1 + hf(xj) + Vhg(xj)^ i+1 . 



We set 



1 + hf{xi) + \fhg{xi% 



i+1 



= In 

= E [Aj + i| Fi] , 
di+i = Aj+i — $j. 
The expectation <3>j can be estimated by Theorem 5, 

(23) = hf{ Xi )(l + o(l)) - h^-(l + o(l)). 

9 



On the other hand, it is easy to see that di + \ is martingale-difference. Using Theorem 5 
once again (now with <p = In 2 |1 + x\) we can estimate 

E[d 2 +1 \^} = E[A 2 +1 |^]-$ 2 = / i /(x l )o(l) + V(^)(f+o(f))-$ 2 
(24) = hg 2 (x n ) (l + o(l)), 

where to get to the final result we used condition (19) and estimate (23). We remind the 
reader that o(l) — > as i — > oo. 

Part a). Now we would like to apply the Toeplitz Lemma (Lemma 10) to the left-hand 
side of (20), where In \x n \ is expanded as in (22). To apply Toeplitz Lemma we need to 
show that the event 

oo 

A = {uj G Q : ^2g 2 (xi) < oo} 
i=i 

has zero probability. Since, by assumption, X; L — > a.s., we have f{xj) = 0(g 2 (xi)) as 
% — > oo. Thus we conclude that on (almost all of) A the series Ei^i i s convergent 

too. Consequently, the series E^li E^i ®i an d E^i E [^ 2 +i| ^i] are all absolutely 
convergent on A. 

We now rewrite (22) as 

k-l fc-l 



In = In |x | + $i + di+i 



i=i i=i 

and notice that the right-hand side is convergent. This, however, contradicts our assump- 
tion that Xi — > a.s. We conclude that A is a zero-probability event. As a consequence, 
we obtain that the characteristic of the martingale EI=i di+i ^ s divergent too, see equa- 
tion (24). 

We can now write 

(25) hm — — — = km \. . + km 



*°° e"=i # 2 (^) n ^°° Er=i # 2 (^) n ^°° Er=i 9 2 i x i) ' 

Tke first limit on tke rigkt can be evaluated using (23) and Lemma 11, 

EITi 1 g; /(xQ (i + o(i)) h g^j (i + o(i)) 

km TO * ' r = /i km — '- - - km — = hL - h 2. 

n ^°° E*=i 9 r\ x i) 9 \ x i) 2»-oo g 2 (xi) 

The second limit in (25) is represented as 

™ eiu^) —~ Er=i e [^+ii ^] ™ Ys=i9 2 {xi) 

Wkile tke second limit on tke rigkt is finite (equal to h to be precise), tke first one is 
zero by Lemma 2. 

Part b). We follow tke proof of part a) witk f(xi) instead of g 2 (xi). By a similar rea- 
soning we conclude tkat tke series Ei=i 1/(^)1 ^ s divergent. Indeed, if it were not so, tke 
series Y^Li9 2 { x i) would be convergent too, since g 2 {xi) /\f(xi)\ — > 0. We tben conclude 
tkat tke series E^i ®u E^i ®i an d E^i E [d 2 +1 \ Ti\ are all absolutely convergent and 
tkerefore In |xfc| converges to a finite limit. Tkis contradicts our assumptions. 

We write 

(26) km * n| , X ;' ., = km J?^.?\. + km E ^ di+1 



^°°Er=i 1/(^)1 n ^°° Er=i 1/(^)1 n ^°° Er=i i/(^)r 
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and evaluate the first limit using Lemma 11, 

lim .yiim /(X - )(l + Q(1)) h 9^(1 + 0(1)) h h_ x0 

To conclude the proof, the second limit in (26) is evaluated to zero as in part a). □ 

5.3. Rate of decay of In \x n \. Theorem 14 provides some information on the decay of 
solutions x n to zero, but does it in a rather implicit way. We will now show how one can 
extract an explicit estimate on the decay of In \x n \ as a function of n. 

Consider the following example. Let it be given that x n — > a.s. as n — > oo (see 
Theorem 6 for a set of sufficient conditions) and let condition (19) be satisfied. Assume 
that the function g(u) behaves like a power of u around zero, 

lim - - - = const. 

Then, using the following lemma we can conclude that 

,. ln|x„,| 
lim 



n-+oo In (n 1 /^s) 

Lemma 17. Let A > and x n be a positive sequence satisfying 

In x 

Then 



(27) lim x n = and lim =^ ^ = — b < 0. 

' 2-<i=l X i 



lim ^ = -1/A. 
- Inn 



n— »oo 



Proof. We will prove the lemma for A = 1; the general case would follow with the change 
Consider a new variable y n = YH=i x i- With Ay n — y n — y n -\ we can rewrite 
the second condition in (27) as 

lim ^ = -b. 

n^oo y n 

By applying the definition of limit, given a small e > we can find N such that for all 
n>N 

\nAy n 

< —(b — e) < 0. 

Vn 

This can be transformed into 

1 > e {h - £)Vn Ay n . 

Applying Lemma 12, (ii), we obtain 

1 1 fVn 

\ e {b-e)y n _ e (b-e)y N l = _ / e (b-e)u du < L 

n(b-e) L n J m 

Solving for y n gives 

^ In [Cm + C 2 ] 

Vn < 



(b-e) ' 

where C 1 and C 2 are constant with respect to n. Sending n to infinity we obtain 
(28) lim sup < 



n^oo Inn {b-e) 
To obtain a similar bound from below we notice that 

Vn _ Vn—l 

Vn-1 Vn-1 
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1, 



and therefore 



lnAy n 
hm = —b. 



Retracing our steps with +e instead of — e and applying Lemma 12, (iii), produce 

1 1 /•J/n 

-L r f^j.^,,, fk_i_^\„,..n J- / 



n(6 + e) 

and, ultimately, 



1 /•J/n 

\ e (b+e)y n _ e (b+e)y N l = £ / e (6+e)« du > j 

n Jy N 



(29) li min fJ^> 

n^oo Inn (o + e) 

Since £ was arbitrary, we obtain from (28) and (29) 

hm = -, 

n-><x> in n o 

and, using the definition of y n and condition (27), 

lnx n lnx n y n 1 
hm = hm = — o— — — 1. 

n^oo Inn n-^oo y n In n o 



□ 



Next we formulate a corollary which extends and formalizes the discussion at the start 
of the present section. 

Corollary 18. Suppose that f and g are bounded with /(0) = g(0) = and the random 
variables £ n satisfy Assumption 1. Assume, further, that x n — > a.s., where Ob yi %S Gj 
solution of (5). If one of the following conditions is fulfilled, 

a) 



/(«) ^ n r /(«) 
__ — -T- = c < 0, hm — 

m^O |«| A m^O gr(uj 



(30) lim ^1 = c < 0, lim £^ = -oo, 



or 

b) 



then 



lim^-^ = c>0, lim^-^- = L<-, 

u^O \u\ X u^O g[u) 2 2 

,. ln|x n | 1 
hm 



Inn A 
Proof. For the solution x n we have 

lim =j£ ^-rr = hm lim f ^ = /i lim = /ic < 0, 

where the first limit was calculated using Theorem 14 and the second was done using 
Lemma 11 and condition (30). Now we apply Lemma 17 to finish the proof of Part a). 
The proof of Part b) is analogous. □ 

Remark 19. Relation 

i- ln l x «l 1 ^ n 

hm — ■ = — — < 0, a.s. 

n^oo In n A 

implies that for every e > there exists N = N(e, 00) such that a.s. for all n > N(e, 00) 

n~^~ £ < \x n \ < n~^ +£ . 
12 



We would also like to mention that Lemma 17 can be extended to include other forms 
of the functions f(u) and g 2 (u) around the origin. We give this result here without the 
proof, which is a simple extension of the proof of Lemma 17 (see also Theorem 5 of 

Lemma 20. Let x n be a positive sequence satisfying 

In I x n I 

lim x n = and lim =^ — — ^ — — = — b < 0. 

n^oo n ^°°2^i=l\f( X i)\ 

Suppose there exists a function a(u) satisfying 

• a(u) is monotone increasing, 

• \f( u )\/ a ( u ) ~* 1 as u ~^ o+> 

• the function A(z), defined by A(z) = -^x, obeys 



Um \n[A-\y-y*)} = ^ 



y^oo 



In [A- 



for any constant y* 

Then 



v hi|a; n | 

lim - = 1. 

«-»oo in [A {n)\ 

6. Exact Rate of Decay 

In this section we derive the exact decay rate (or prove its absence) in the case when 
/ and g have power-law behavior: 

(31) f(u) a f \u\^, g 2 {u)~a g \u\^ as u -> 0, 

where ///, a 9 > and a/ 7^ 0. 
We will assume that 

(32) l im ^)<l. 
and that x n — > 0. 

The assumptions above ensure that the conditions of Corollary 18 are satisfied, which 
gives us a preliminary estimate on the rate of decay of x n (see Remark 19). The aim of 
this section is to strengthen the result of Remark 19 to the result of the type x n n x — » const 
or to show that such strengthening is impossible. 

Remark 21. It is clear that if / and g are given by (31) then condition (32) holds in the 
following three cases: 

(i) (if > fig, 

(ii) fif = fig and —2a/ < a g , 

(iii) fif < fig and a/ > 0. 

We will also need to strengthen Assumption 1 about the noise £ n : 

Assumption 2. Let £ n be independent random variables. We assume that E£„ = 0, 
E£ T 2 t = 1 and for each m e N there is a C{m) > such that 

(33) E[|e„| m ] < C(m). 

An important example of the noise satisfying Assumption 2 are the i.i.d. normal £ n . 
The condition (33) implies that the large fluctuations of £ n grow slower than any power. 

13 



Lemma 22. Suppose that (33) holds. Then for every fixed e > 



lim n £ \(, n \ = 0, a.s. 

This lemma is a direct consequence of (33) and the Borel-Cantelli lemma. 

Corollary 23. From power-law decay of x n (Remark 19) and Lemma 22 we conclude 
that for every fixed e > 

lim |x n | £ |£ n | = 0, a.s. 

n^oo 

In particular, g{x n )$ >n+ i ^ as n — > oo. 

For the sake of simplicity everywhere below we are going to hide h and \fh. In other 
words we let 

/ := hf, g := Vhg. 

Remark 24. Since x n — > 0, f(x n ) — > and g{x n )£ n+ i — > as n — > oo, after some random 
number of steps the bracket 

(1 +f(x n ) +g(x n )£ n+1 ) 

becomes positive. In particular, it means that solution x n eventually stops changing sign. 

6.1. Main Results. It turns out that, in the situation described in case (iii) of Re- 
mark 21, the decay rate is exact. 

Theorem 25. Suppose Assumption 2 holds. Let aj > and /if < /i g . Then 

i 

"/ 

, a.s. 

The intuitive reason for the above behavior is that the convergence under the conditions 
of the Theorem is dominated by the deterministic terms of the recursion and the rate 
coincides with the corresponding deterministic (£„ = 0) rate. 

On the other hand, if conditions of cases (i) or (ii) of Remark 21 are met, then x n 
undergoes large oscillations around the power law decay. This is because the convergence 
is induced by the noise term, which is now significant. More detailed explanations are 
given in Remark 28 below and, of course, in the proofs in Sections 6.3 and 6.4. 

Theorem 26. Suppose that Assumption 2 holds. Let either /if > /i g or fj,f — /i g and 
—2af < a g hold (cases (i)and (ii) of Remark 21 correspondingly) . Suppose moreover that 
g{u) > for u > and there exists some r > such that 

(34) —u-^/^g^u) = l + (u r ) as +0. 
Then 

i 

(35) limsup |x n |n M 9 = oo, a.s. 

n^oo 



lim {xnln^f 



a f Hf 



(36) 



liminf lajjn^ =0, a.s. 

n— >oo 
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6.2. Main Construction and an Outline of the Proofs. By squaring both part of 
(5) with / := hf, g := Vhg, we obtain the equation 



x l+i =x 2 n (l + F n + R n+1 ) , n = 0, 1, . . . , 
F n = 2f{x n ) + f 2 {x n )+g 2 {x n ), 



(37) 
where 
(38) 

(39) R n+l = 2(l + /(j; B )) ff (i B )U + ff 2 WC-l). 

Remark 27. Under conditions of this section, F n , R n+ i — > a.s. as n — > oo. 
Let a, /i 6 I, /i > and z/ = ^ . We define for w > 



(40) 



G(«) 



u 



av 



x > 0. 



G(^ +1 ) = G(^ + x^(F ri + J R n+1 )) 



Assuming that x n 7^ 0, we apply the Taylor expansion with three terms to obtain for x 2 n 
a.s. 

(41) 

with 

(42) 
Let 



G(x 2 n )--\x n \-^(F n + R n+1 ) + 



u + 1 
2a 



T]-^ 2 \x n \ 4 (Fn + Rn + l) 2 , 



\Vn+l-X 2 n \ <X 2 n \F n + R n+1 \. 



— Vn+1 ^ X n + ^ • 



We can rewrite (41) in the following form 

1 



(43) G(x 2 n+1 ) = G(x 2 n ) - -\x n \-»(F n + R n+1 ) + —-\ Xn \^(F n + R n+l ) 

+ V -^{^n+i - l)\x n \-"(F n + R n+1 ) 2 
la 



where 
(44) 

(45) 
(46) 

(47) 



P 



n+l 



2 

Xr, 

a 



= G(x 2 n ) + P n+1 + p n+1 + T n+1 , 

+ Qn+1, 



Pn+1 — \x n \ ^Q^njCn+lj 



l~n+l = 



a 



a 



1 



Qn+i = \x n \ M / (x n ) + 2f(x n )g{x n )£ n+1 

a 



+ 
+ 



/j + 2 

4a 
/j + 2 

4a 



^r"(i^ + 2F n i? n+1 + (n n+1 - l)(F n + ^i) 2 ) 
x n \-»Uf 2 {x n )g 2 {x n )e n+1 + 8/(x n )<7 2 (a; n )£ +1 



+ ^ 4 K)(^ + i - i) 2 + V(*„)(i + f(x n ))(e n+ i - i)6 t+ i). 
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Let 
(48) 



/if if /if < 

H = \ fig-fif if ^-<fi f <fi g , 

T if /i/ > fig. 



n— 1 n— 1 

M n = ^ Pi+1 aIld T n = ^ ri+1 

i=0 i=0 



Since p n and r n denned by (45)-(46) are ^-martingale-differences, 
(49) 

are jF^-martingales. After summation of (43), we arrive at 

n-l 

(50) G(x 2 n ) = G(4) + P ^ + M « + T «- 

i=0 

Remark 28. (Outline of the proof of Theorems 25 and 26). The decomposition 
of G(x 2 l+1 ), equation (43), is constructed in a way that highlights the different types of 
convergence as n — * oo for different values of fi. 

Firstly, the term P n+ i is made up from 3 parts. The last part, Q n +i, is subdominant to 
the first two for all values of fi. When fif < fi g the limiting behavior of P n +i is dominated 
by the function /, while when fif > fi g , the function g determines the behavior. 

When /if < fig/2 we set fi — fif and show that both p n+1 and r n+1 a.s. tend to zero 
as n — > oo and P n+ i tends to 1 as n — > oo. This means that asymptotic behavior 
of G(x 2 l+1 ) — G(x 2 n ) is determined by P n+1 and the result can be obtained directly by 
Toeplitz lemma. 

When fig > fif > fig/2, the martingale- difference p n +i no longer tends to zero if fi = fif. 
To get around this difficulty we set fx = fi g — fif and show that in this situation both 
P n +i + T n+ i and E T r /\ behave like |x„| 2 ^~ M9 as n — > oo. By means of a martingale 

convergence theorem, namely by Lemma 2, we compare the behavior of G(x 2 l ) with that 
of YlZi W 2m/ ~ M9 and apply Corollary 13. 

When fif > fig, both p„+i and r n+1 decay slower than P n+ \ for all values of fi. We 
set fi = fig/2 so that E [(p n +i + 7~n+i) 2 | Fn] ~^ 1 an d P n +i ~ |^n|^ 2 as n — > oo. This 
allows us to apply a consequence of the central limit theorem (see Lemma 33 below) and 
decomposition (50) to obtain the conclusion of Theorem 26. 

The rest of this section we devote to verifying that Q n +i is subdominant to the other 
terms in P n+ \. 

Lemma 29. There is some K = K(fi) > and N = N(K,u) such that for all n > N 
we have 

(51) \Kn +1 - 1| < K\F n + R n+1 \. 
In particular, a.s. K n — > 1 as n — > oo. 

Proof. From (42) we have 

Vn+1 



(52) 

Since for any A G R, 



n ~r Ji-n+l| 



|/ A - 1 

lim = A, 

y — 1 
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for any K > |A| we can find 5 > such that 

(53) \y x -l\ <K\y-l\ 

when 1 2/ — 1 1 < S. Letting A = — (/i/2 + 2), and using (52) and Remark 27, we can find 
N(K, u) such that for all n > N(K, u) 

\F n + R n +i\ < 5, 

which, together with (53), implies (51). □ 

Lemma 30. Let /i be as defined in (48), and s = min{/z/, fi g }. Then, for any e > 0, a.s. 
Qn+i ~ 0(x s n ~ 6 ) as n — >■ oo. 

Proof. By application of Corollary 23 for any e > we obtain that a.s. 

K n+ i - 1 = O (\x n \^ s + \x n \^~ £ ^ , as n — >• oo, 
and then, from (47), 

(54) Q n+1 = O (\x n \-^f + \x n \-^f + ^- £ + \x n \-^- e ~) . 

Now the proof can be completed by direct substitution of different values of /i from (48) 
into (54). □ 

6.3. Proof of Theorem 25. 

6.3.1. An auxiliary lemma. 

Lemma 31. Let aj > and jif < fi g . If we set ji = fif, and a = 2a/ > in equations 
(44), (46) then 

lim [P n+ i + T n+1 ] =1, a.s.. 
The result follows from equations (31), (44), (46), Corollary 23 and Lemma 30. 

6.3.2. Proof of Theorem 25. We consider two cases: 

(i) fi f < ln 9 , 

(ii) \Hg <fif< fig- 

Proof of Theorem 25, case (i). We set /i = fif, and a = 2af > in equations (44)-(47). 
By Corollary 23 for e < ^ — fif we have a.s. as n — > oo 



Pn+l = O (\x n \-^~^ ^0. 



Then from Lemma 31 we obtain that for n — > oo 

G(x 2 n+1 ) - G{xl) ^ 1, a.s. 
which together with Toeplitz Lemma and (40), implies that a.s. for n — > oo 

naffif n n 

□ 
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Proof of Theorem 25, case (ii). We set /x = \i g — /i/, a — -^j in equations (44)-(47). We 



eorem zo, case {%%). we sex /i — /i g — /if, a = 2 "" 

also denote 

b:=^>0, A := 2/j/ -fig > 0. 



a 5 



Applying again Corollary 23 and Lemma 30 and reasoning in the usual way we get a.s. 
as n — > oo 







-2(/ig-/i/) 


6|x n | 


X a 9 







l 00 J 1,1™ IA _ „ I™ I2u f -u„ X > 



(56) ^feP ' 

Now we prove that a.s. 



(57) hm £ 

r>. — >oo * * 



|x,;| A = OO. 



n^oo ■ 

i=l 



Indeed, let Qi = {uj : lim^^ El=i l x «| A < °°}- Then from (55) and (56) we obtain that 
on Q,i we also have 

oo oo 

^[Pi+i + 7- i+ i] < oo and ^E[p^ +1 |J^] < oo. 

i=i i=i 

The last relation implies that lim n ^oo M n is a.s. finite on Q± and then equation (50) 
implies that \im n ^ 00 G(x n ) < oo a.s. on But since x n — > a.s., the probability of f2i 
must be zero. 

Relation (55) together with (57) implies that a.s. 

• 1, 



Er=i E [p?+i 




eiu & : 


| 


A 



which results in 

( 5§ ) |A ^ 0. 

E i= ifrN A 

On the other hand, relation (56) together with (57) implies that 

E"=i [ p m + r i+i) _^ j 

which together with (58) gives 

li m gi^j = 1. 

n ^°° E"=i fo N A 

After applying (40) and rearranging, we arrive at 



i 



(59) 

Now we are going to apply Corollary 13 from Lemma 12. We set 7 = A//i and c = j . 

We define y n := E^i* l x »| A > so xnax = l a; n| A anc ^ \ x n\^ — (^Vn) 1 ^- Now relation (59) 
takes the form 

(Ay n ) 1/7 ?/ n+ i 



a//i 
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which, together with — > 1, implies 



(Ay n ) lh y n -> 

a/// 

or, equivalently, 

(60) ^Ay n -> c. 

By applying Corollary 13 we obtain 



Jk__>( c (l + 7 ))rR or _^_->( c (l +7 ))i* 
The last limit together with (60) gives 

7 

7 1 + 7 7 

(61) Ay n n— = (yZAy n ) x — -> c(c(l + 7 )) . 

Substituting the values for Ay n , 7 and c in (61) gives the desired result. □ 

6.4. Proof of Theorem 26. 

6.4.1. Auxiliary lemmas. The following lemma can be considered as a corollary of a ver- 
sion of strong law of large numbers for square-integrable martingales (see e.g. [20], page 
519). 

Lemma 32. If M n is a square-integrable martingale with the quadratic characteristic 
(M n ) and (M n ) — > oo ; then for any 7 > 



7 



lim 



M„ 



rzz> {(M n )yf^ ~ ' a ' s ' 

Define $ G C(R; R) by 
(62) $(ar) := f dy. 

Assumption 2, due to Liapunov, gives rise to the following form of the Central Limit 
Theorem (see e.g. [6], page 362). 



Lemma 33. Let Assumption 2 hold. Then 



lim P 



1 n 



> X 

n ' =1 J 



1 — <&(z), forallxeM, 



where $ is gweri fry (62). 



The following result is then a simple adaptation of the argument presented on p. 380-1 
in [20]. 

Lemma 34. Suppose that {£ n } nG N obeys Assumption 2. Then 

(63) limsup^=> & = 00, liminf^=> ^ = —00, a.s. 

v i=l v i=l 
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Proof. For c > define the events 

Y n 1 n 

A c = {uj : lim sup —= £j > c}, A = {cj : lim sup — p= ^ = oo}. 

1=1 v «=1 

Then A c j A as c — > oo. The events A c are tail events; therefore, by independence of the 
sequence {£ n }neN and the Zero-One Law, it follows that 

(64) P[Ac] > for every c> 

implies P[A C ] = 1, and so F[A] = lim^oo F[A C ] = 1. Therefore it suffices to prove (64) to 
establish the first part of (63). 

Using (i) the fact that for any sequence of random variables {^ n }ngN we have 

{uj : lim sup r) n (u) > x} D {oj : r] n {uj) > x i.o.}, for all i6K, 

n^oo 

(ii) the fact that P[B n i.o.] > limsup^^ P[B n ] for any sequence of events {B n } neN , and 
then Lemma 33 in turn, we get 



P 



1 n 
lim sup —= ^2 & > 

n-^oo V Tl . 

v i=l 

1 n 



> P 



> lim sup P 



i=l 



lim P 



1 " 

. »=i 

1 n 



i=i 



l-$(c), 



proving (64). 

The second part follows from the first using the change & — > — £j. 

Lemma 35. Lei a = 2 v /a^ and /i = fJ, g /2. Then 

((t -, v -{M n + T n ) M n + T n 

(65) hmsup — = oo, hmsup -= — = oo, a.s. 



□ 



Proof. We consider the case when /i g < /if, and therefore we are under conditions of 
Corollary 2, b). Then, according to Remark 5, for any e > 

— — —£ — — +e 

(66) n M » < |rr n | < n M « 

for all n > N(e,u). We choose 5 < ^- and in the following consider only n > N(e,u). 
We define M n and p n +i as above and rearrange 

Pn+l : = _ £n+l + Pn+1, 

where 



Pn+i — 



X r . 



-tig Ii 



£n+l — o(\x n \ r )^ n+ i. 



Let M n = YH=i Pi- We prove that 



lim -— ^ = 0, lim — ^= = 0, 

n— >oo yfn ra— >oo yjjl 

which in conjunction with the conclusion of Lemma 34 ensures the desired result. 
We want to estimate (p n ) . Since 

\x n \ < n v m 9 j 

we have 



{pn) < \x n \ 2r < Kn r y~^ +£ ) < n~ s 
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for some 5 G (0, 1). Since, as n — > oo, 

^ 1-5 



i=l 

we have 

n 

(M n ) < K^r 5 ~ f^n 1 ^. 
i=i 

For fixed <5 we choose 7 > such that (1/2 + 7) (1 — 5) < 1/2. Indeed, it is possible for 

7 < 2(h)- Then 

, (W) 1/2+7 n 

hm j= = 0, a.s. 

Hence by applying Lemma 32 we have 

,. ^ r M n r ((M w )) 1/2+7 
hm —= = hm — = . hm — = 0. 

We dehne T n and r n+1 as before. Since 

r n+ i = -^^v^wr 12 [i + o(\ Xn n] 2 - 1), 

applying (66) with e < ^- we estimate for n > N(e, 00) 

(r n+ i) = a a \x n \»> [1 + o(\x n \ r )} 4 (E£ 4 +1 - 1) 

< K 2 \x n \^(E£ n+1 - 1) < ir 3 (^)n- 1+ ^(EC 4 t+1 - 1). 
Then, as n — > 00, because the fourth moments of £ n are uniformly bounded in n, 

n n 

{T n ) < YK 3 (uj)t~ 1+ ^(Etf +1 - 1) < sup{EC 4 - 1} x if 3 ( W )Vr 1+ * ~ ^ 4 n £ ^. 
i=i ieN i=i 

Therefore, as 2/i 9 e < 1, we have (T n ) / \pri — > as n — > 00 a.s. Also, by the strong law of 
large numbers for martingales T n j (T n ) — > as n — > 00, a.s., so 

lim — ^= = lim " lim - " ^ = 0. 

n-+oo y'Ti n— >oo (T n ) n^oo y/fl 

Applying Lemma 34 a.s. we get 

M n + T n Er-i(-Ci) M n ,. T n 

hmsup — — = hmsup — h hm — p= + hm —= = 00, 

as required. The proof of the 2nd part of (65) is similar. □ 

Lemma 36. Let either /if > /i g or /if — /i g and —2a/ < a g hold. We set ji = fJ, g /2, and 
a = 1^fa~ g > in equation (44)- Then 

(67) lim -. Pn +' . = S > 0, 

a{fj, + l)\x n \^ 

where the number S is non-random. 
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Proof. From equation (31) and Lemma 30 we obtain that a.s. as n — > oo 



2 \x n \ 2 » 4' 
0. 



Qn+1 



a(/i + l)|x„|' i 

The above relations imply (67) with S — L + |. Note that 5 > even if a/ is negative. 
Indeed, if this is the case and /if — /i g 

at —a a 1 1 

> o ? ^ — = —777 7TC > -T, 



a 9 (/i 3 + 2) 2a 3 (/i 9 + 2) 2(ji g + 2) 4 : 
since — 2a/ < a s . The lemma is proved. □ 

6.4.2. Proof of Theorem 26. We set \i = fJ> g /2, a = 

Proof of (35). First we rearrange (50) in the following way 

n-l 

Pi+i = G(x n ) - G(x ) -M n - T n . 

Due to Lemma 35, 

-(M n + T n ) 
lim sup ■= = 00, 

'n 



and moreover, since G(x n ) — > 00, we conclude that 

v-»n-l p 

(68) lim sup ^=o_f t+1 = 00. 

By applying Lemma 36, we conclude that P n +i is positive for big enough n. Thus 
^"Tq 1 Pj+i has a limit as 11 — > 00, finite or infinite. Consequently, (68) implies that 
the limit is infinite. Together with Lemma 36 this implies that \ x i\^ can n °t be 

finite on a set of nonzero probability, i.e. \ Xi \^ = 00 a - s - Therefore we can apply 

Toeplitz Lemma, or Lemma 11, and obtain that 

Y^n-l p p 

l im ^i=o tJ±l = i im ^+1 = 5 > 0. 

a(fi + 1) ELo kil" n ^°° + ^l^r 
Combining this with (68) gives 



En— 1 I 
i=0 P» 1 
11m sup — = 00. 



Since 



we can estimate 



1 n 1 



2 

i=i 



.1 ; 



limsup ^— j — j- = limsup ^ r > limsup j= = 00. 

Applying Lemma 11 again, from the last limit we conclude that 

limsup \f\xn\vyn = limsup \x n \^^/n = 00. 

n^oo n^oo 
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□ 



Proof of (36). In the previous part we proved that X^o-^+i = 00 > therefore 

sr^n-l p 

liminf ^=V m >0. 

n->oo yjn 

After dividing both parts of the decomposition (50) by \fn, taking the limsup of both 
parts and applying Lemma 35 we obtain 



,. G(x n ) 
hm sup — =— = hm sup 



n 



n-1 



G ( x o) A 1 ^ p M n + T n 

' lr > \/n 
i=0 v 



Therefore, 



M n + T n 
> limsup — — = oo. 

n-+oo V Tl 



oo = hm sup — -=— = — hm sup 



.i t 



or 



liminf A/rija^ps = 0. 



The theorem is proved. 



□ 
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